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I  Introduction 

The  list  of  applications  for  thermal  imaging  systems  (TISs)  is  forever  expanding.  It 
starts  on  the  battlefields  of  the  military  for  the  detection  of  strategic  targets  and  spans  into 
areas  like  the  surveying  of  air  pollution  in  our  metropolitan  areas  and  medical  diagnosis  such 
as  the  detection  of  breast  cancer^.  The  growing  use  of  these  systems  is  continuously 
challenging  engineers  to  predict  the  performance  of  their  systems  during  the  designing  stages 
before  the  expense  of  assembling  the  system  and  without  timely  testing  of  the  system  under 
the  same  conditions  of  its  intended  use. 


Much  work  has  been  done  to  model  the  performance  of  TIS’s  based  on  design 
specifications^’^’®.  A  major  limitation  of  these  models  is  their  attempt  to  include  the  human 
observ’er’s  ability  to  detect  an  object  displayed  on  a  monitor.  This  paper  includes  the  work 
of  Hans  Roehrig  et  al.  at  the  University  of  Arizona’s  Radiology  Department.  They  have 
experimentally  measured  both  the  output  and  noise  characteristics  of  several  "state  of  the 
art"  display  monitors^’®.  They  also  performed  several  psychophysical  experiments  which 
characterize  the  human  observer’s  response  to  various  test  patterns  projected  onto  the  same 
monitors^.  They  found  close  correlation  between  the  physically  measured  signal-to-noise 
ratio  and  the  psychophysically  determined  threshold  contrasts  and  "Just  Noticeable 
Differences"  (JND’s),  which  is  the  smallest  luminance  difference  AL  that  can  be  displayed. 
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11  Background 

Figure  11,1  depicts  the  basic  application  of  a  TIS.  The  target  of  interest  is  surrounded 
by  a  cluttered  background.  The  photon  flux  difference  generated  by  the  temperature 
difference  between  the  target  and  its  background  is  considered  to  be  the  signal. 


The  optical  signal  passes  through  the  atmosphere  which  attenuates  the  signal  and 
blurs  the  image.  The  effects  from  this  atmosphere  are  continuously  changing  and  can  be 
quite  complicated  to  model.  Therefore  the  influence  of  the  atmosphere  will  be  neglected 
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in  this  model.  The  addition  of  known  atmospheric  parameters  for  a  particular  application 
can  be  added  later  using  the  methodology  presented  below. 

The  modeling  will  predict  the  capability  of  the  system  to  detect  a  simple,  stationary 
target  like  the  square  test  pattern  of  Figure  II.2  where  the  target’s  area  is  and  its 
temperature  is  T^  and  the  temperature  of  the  background  is  Tj,.  Use  of  this  test  pattern  will 
eliminate  the  need  to  include  functions  such  as  the  optical  transfer  function  (OTF)  of  the 
lens  and  the  modulation  transfer  function  (MTF)  of  the  electronics  which  describe  the 
systems  response  to  spatial  and  temporal  frequencies  in  the  object. 


Background  Temperature 

Object’s  Area  A, 
Object’s  Temperature  T 


Figure  II.2:  A  sample  test  pattern 


The  various  subsystems  of  Thermal  Imaging  Systems  (TISs)  which  are  included  in  this 
model  are  shown  schematically  in  the  block  diagram  of  Figure  II.3.  The  remaining  sections 
of  this  background  are  each  dedicated  to  describing  a  separate  subsystem. 
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Figure  II.3:  A  Block  Diagram  of  a  Thermal  Imagng  System  (TIS) 


II.  1  The  Scene 


The  typical  viewing  scene  contains  a  target  of  interest  surrounded  by  a  baokcraunJ. 
For  detection^  this  target  must  exhibit  an  effective  temperature  difference  tram  :ts 
background  of  sufficient  magnitude  to  distinguish  it  from  normal  variations  in  the 
background.  This  temperature  difference  can  be  due  to  an  energy  exchange  u:ih  the 
environment,  an  emissivity  difference,  self  heating  or  from  the  reflection  off  of  other  source.  ■ 


5 


II.2  The  Detection  System 

The  detection  system  is  made  up  of  a  combination  of  imaging  optics  and  a 
photodetector  followed  by  processing  electronics  which  first  amplify  the  low  level  analog 
signal  from  the  detector  and  then  sample  it  with  an  analog  to  digital  (A/D)  converter.  This 
digital  signal  can  either  be  sent  to  a  computer  for  evaluation  or  to  a  video  monitor  where 
it  is  displayed  for  a  human  user. 

The  exact  nature  of  this  system  has  varied  from  the  early  days  of  a  single  detector 
element  scanned  to  provide  a  2-D  image  of  the  scene,  to  the  widely  used  1-D  "linear" 
detector  array  requiring  only  one  mirror  to  perform  scanning  in  the  orthogonal  direction. 
Future  systems  will  incorporate  current  2-D  focal  plane  detector  arrays  and  eliminate  the 
need  for  mechanical  scanning. 

II3  Digital  Recognition 

Evaluation  of  the  scene  and  any  targets  in  it  can  be  accomplished  in  a  purely  digital 
manor  with  a  variety  of  processing  algorithms.  The  first  step  includes  signal  processing  such 
as  scaling,  rotation  and  edge  enhancement.  The  next  step  is  to  compare  the  signature  of 
the  target  to  a  data  base  containing  various  objects  of  interest. 

This  comparison  can  be  accomplished  in  a  digital  computer  with  the  use  of  algorithms 
such  as  the  Fast  Fourier  Transform  FFT  and  "Matched"  filtering  to  perform  a  correlation 
which  will  result  in  a  peak  output  from  an  auto  correlation  when  the  stored  and  input  target 
match.^ 
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Another  approach  includes  transferring  the  enhanced  image  and  the  many  filters  to 
the  optical  domain  via  2-D  Spatial  Light  Modulators  (SLMs)®.  This  approach  utilizes  the 
instantaneous  Fourier  Transform  properties  of  a  lens  to  provide  a  real  time  two  dimensional 
correlation  which  could  theoretically  scan  through  more  filters  in  a  given  time  period. 

These  digital  recognition  systems  require  such  a  large  database  of  comparative  filters 
that  they  aren’t  practical  at  this  point  in  time.  Therefore  they  won’t  be  the  focus  of  this 
paper  but  references  7  and  8  are  offered  for  interested  readers. 

II.4  Psychophysical  Recognition 

Standard  TISs  utilize  the  capabilities  of  the  Human  Observer  to  evaluate  the  target 
in  a  scene.  The  signal  from  the  detector  system  typically  has  a  raster  structure  with  TV  type 
frame  rates.  This  signal  is  projected  on  a  display  device  such  as  a  CRT,  an  Image  Intensifier 
Tube  or  a  Light  Emitting  Diode  Array.  These  display  devices  typically  provide  adjustable 
video  gain  and  background  level  to  improve  the  image  contrast  and  brightness. 

The  observer’s  task  is  to  detect  an  object  or  point  on  the  display  as  a  potential  target 
of  interest.  Once  detected  the  observer  must  recognize  the  object  as  a  member  of  a  class 
of  targets,  ie.  a  person,  vehicle  etc.  Utilizing  all  of  his  past  training,  experience  and  image 
interpretation  skills,  the  observer  must  then  identify  the  target  as  a  particular  member  of  the 
class  of  objects  ie.  a  model  M60,  T62,  or  M551  tank®.  * 
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III  Characterization  of  TISs 

To  analyze  the  limitations  of  a  TIS  one  starts  by  modeling  the  performance  of  each 
component  based  on  its  design  parameters.  The  individual  performance  and  limitations  of 
each  device  must  then  be  cascaded  to  predict  the  performance  of  the  system  as  a  whole. 
To  relate  the  various  devices  one  must  be  familiar  with  the  conversion  relationships  between 
unit  quantities  since  the  outputs  of  the  stages  are  different.  For  instance;  the  scene’s  output 
signal  is  represented  in  number  of  photons,  the  photons  are  converted  into  electrons  in  the 
detector,  whose  output  can  be  a  current  or  analog  voltage  level.  The  A/D  converter  outputs 
a  digital  series  of  voltages,  and  the  monitor’s  frame  buffer  interprets  these  digital  grey  levels 
(GLs)  as  voltage  levels  applied  to  the  electron  gun  and  the  final  output  is  luminance. 

A  more  convenient  method  of  comparison  would  include  a  unitless  figure  of  merit 
which  could  be  defined  for  each  component. 

III.l  Signal  to  Noise  Ratio 

A  solution  to  the  above  problem  is  to  find  the  signal  and  noise  outputs  of  each  stage 
and  cascade  these  values  to  determine  a  signal-to-noise  ratio  (SNR)  of  the  total  TIS.  The 
signal  to  noise  ratio  is  a  unitless  characteristic  which  provides  a  theoretical  limit  for  the 
performance  of  a  system^  Mathematically,the  SNR  per  pixel  (SNRp)  is  the  ratio  of  the 
mean  value  of  the  output  signal  (x)  of  a  single  pixel  over  the  image  to  the  standard  deviation 
(a)  "noise"  of  the  same  signal. 
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SNR  (III.l) 

^  noise  a 

The  SNR  is  used  to  determine  figures  of  merit  such  as  the  noise  equivaleni 
temperature  difference  (NEAT)^  which  is  a  widely  used  measure  of  a  TIS’s  ability  to 
discriminate  a  small  signal  from  a  background  of  noise.  The  NEAT  is  simply  the 
temperature  difference  between  the  target  and  background  of  Figure  II.2  which  produces 
a  SNR  of  one. 

III.1.A  The  Influence  of  the  Human  Observer 

When  including  the  response  of  the  human  observer  in  a  model  of  a  TIS  one  should 
recognize  that  the  temperature  differences  in  the  scene  are  displayed  to  the  obseiAer  as 
luminance  differences.  Although  the  human  observer  cannot  determine  the  absolute 
luminance  level  projected  from  the  display,  contrast  differences  can  be  detected  quite 
consistently.  As  the  luminance  difference  (AL)  becomes  small  the  detectability  is  dependant 
on  the  presence  of  noise  in  the  signal.  In  order  for  the  signal  AL  to  be  perceived  it  has  to 
larger  than  the  noise  a  by  some  factor  k^:® 

£^L=k^a  (HL2) 

where  AL  =  -  Lbackground  Can  be  interpreted  as  a  threshold  SNR. 

Rosell  and  Willson^”  did  research  in  the  area  of  human  perceptions  and  found  that 
a  SNR  of  at  least  3.1  is  needed  for  a  50%  probability  that  a  human  observer  will  detect  an 
object.  To  increase  this  probability  of  detection  to  -  100%  a  SRN  >  5.3  is  needed.  Roehrig 
et  al.  performed  psychophysical  experiments  using  a  US  Pixel  monitor  and  found  that  for 
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their  system  ko=7.78.  However,  a  word  of  caution  is  necessary  since  Roehrig  et  al,  used  a 
"contrast  detail"  pattern  which  presented  a  series  of  objects  simultaneously.  Here  the  human 
observer  is  not  asked  if  an  object  is  present;  rather  the  objects  are  always  present  and  he 
is  asked  which  one  can  be  seen. 

The  detection  capabilities  of  the  human  observer  can  also  be  described  in  terms  of 
a  threshold  contrast  (CJ: 

(III.3) 

where  Lj,  is  the  luminance  of  the  background  and  hja  is  defined  as  the  display  signal-to- 
noise  ratio  (SNRp).  From  the  model  of  vision  proposed  by  Rose^^  the  SNRp  of  an  object 
displayed  with  a  small  contrast  (C)  is  given  by; 

where  SNRp  is  the  signal  to  noise  per  pixel  and  N  is  the  number  of  pixels  contained  in  the 
object.  Substituting  (III.4)  into  (III.3)  results  in  an  equation  for  the  threshold  contrast  as  a 
function  of  the  SNRp  for  the  observer  to  "detect"  a  target: 

c,=  fl-A.  (IH.5) 

'  N|  NSNR^ 
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The  Influence  of  Each  Component 

As  stated  earlier,  the  goal  is  to  determine  the  SNR  of  each  component  and  to 
cascade  them  to  determine  a  SNRp  of  the  total  system.  Refer  to  Table  III.l  for  a  listing  of 
each  component  in  the  TIS®.  The  second  column  contains  the  factor  which  describes  the 
influence  of  the  device.  The  'Type  of  PDF'  is  the  probability  density  function  which  best 
statistically  models  the  signal  and  noise  of  the  component.  The  mean  (x)  and  standard 
deviation  (a)  relate  to  the  signal  and  noise  out  of  each  device. 


Following  statistical  methods^^,  the  effects  of  two  uncorrelated  variables  can  be  added 
whose  mean  values  (Xj  &  standard  deviations  {o^  &  o^)  are  known: 


if  two  stages  are  cascaded  the  statistics  are^^: 


2  2 

+a. 


(III.6) 


(111.7) 


(111.8) 

(111.9) 


where  Xjj  is  the  mean  and  is  the  standard  deviation  of  stages  1  and  2  cascaded. 
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Component 
of  the  TIS 

Parameter  which 
influences  signal 

Type  of 

PDF 

Mean 

(X) 

Standard 

Deviation 

#1.  Scene 

Photon  emission 

Poisson 

K 

K 

#2.  Imaging 
Optics 

Coupling  Efficiency 

Binomial 

(NAf 

Lens  Transmittance 

Binomial 

T 

A(i-u 

#3.  Detector 

Quantum  Efficiency 

Binomial 

n 

v/ti(1-ti) 

#4.  Amplifier 

Gain 

Poisson 

G 

■la 

#5.  A/D 
Converter 

Quantization 

Uniform 

a 

2 

_a^ 

yi2 

#6.  Display 

Monitor  Electronics: 
Electron  Gun 

Non  Linear 

L=KE’' 

a^=nAS'"-*a^ 

Imaging  System: 
Electron  Beam 

Poisson 

K 

Phosphor  Gain 

Poisson 

0, 

Phosphor  Grain 

Table  III.  I:  Different  Components  and  Their  Influence  on  a  TIS 
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III.l.C  The  SNR  of  Each  Subsystem 

Objects  in  the  scene  are  assumed  to  be  blackbodies  which  are  perfect  emitters  of 
thermal  electromagnetic  radiation.  The  average  photon  flux  (0p)  of  these  objects  is  related 
to  their  temperature  (T)  via  the  Stefan  Boltzmann  law  for  photon  flux  exitance  (Mp)^; 

(III.IO) 

rp  Op  op 

where  is  the  object  area  and  =  1.52  x  photons  sec‘^  cm'^  K‘^.  This  value  0p 
predicts  the  average  rate  of  emitted  photons  over  the  total  spectral  range.  The  exact  photon 
flux  of  infrared  photons  can  be  found  by  integrating  Planck’s  Law  over  the  wavelength  range 
of  interest^.  For  this  model  (III.  10)  is  a  fine  approximation. 

The  mean  number  of  emitted  photons  Np  can  be  found  by  dividing  the  photon  flux 
by  two  times  the  bandwidth  (Af)  of  the  system: 

(III-ll) 

^  2A/ 

The  standard  deviation  (a)  from  Np  is  a  measure  of  the  uncertainty  or  "noise"  present  in  the 
photon  emission.  The  emission  of  photons  can  be  accurately  estimated  using  the  Poisson^"* 
probability  density  function  where  Np  is  the  "mean"  number  of  photons  emitted  in  a  period 
of  time  (Xj),  with  a  standard  deviation  of  Uj  =  /Np.  Using  these  values  the  SNR  for  the 


scene  is: 
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The  average  number  of  photons  in  the  image  plane  of  the  imaging  system  (Npj)  is 
determined  by  the  characteristics  of  the  objective  lens. 


N^=M(NA)^zN^  (III.  13) 

where  M  is  the  magnification  of  the  imaging  system  ^A  is  the  numerical 

aperture,  (NA)^  is  the  coupling  efficiency  and  t  is  the  transmittance  function  of  the  lens. 
Each  of  these  predict  the  probability  of  an  event  happening.  The  throughput  efficiency  is 
the  probability  of  a  photon  in  the  object  plane  being  imaged  onto  the  detector  plane.  The 
T  is  the  probability  that  a  photon  striking  the  lens  will  be  transmitted.  These  noises  follow 
a  binomial  probability  density^'*.  When  cascaded,  the  parameters  of  the  imaging  optics  have 
a  mean  value  of: 


(111.14) 


and  a  standard  deviation  of: 


02=V(M4)2t(l-(A«)2T) 

The  cascaded  SNR  of  the  scene  and  the  imaging  optics  is  then: 


j:,,  MN(NAfx  MAaT\NAfx 
SNR^^=-^=—’’——=  - g-g  -- 

*^12  ^MNjiNAfx  ^ 


(III.15) 


(111.16) 
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Detector  noise  can  be  generated  by  several  mechanism^.  The  conversion  of  the  flux 
noise  in  the  scene  creates  shot  noise,  this  has  been  included.  Johnson  noise  is  due  to 
thermal  current  fluctuations  and  can  be  minimized  by  cooling  the  imaging  and  detector 
assembly.  With  skillful  designing  manufacturers  have  been  able  to  eliminating  the  1/f  noise 
in  photovoltaic  detectors.  This  leaves  the  background  photon  noise  limiting  the  performance 
of  the  detector.  This  situation  is  termed  BLIP^  (background-limited  photodetector) 
performance.  The  average  number  of  photons  (Np^)  on  the  detector  is; 


_ A. _  A/}T\NAfx 

N  g- 

MA^  M2Af 


(III.17) 


where  is  the  area  of  the  detector  element,  M  is  the  magnification,  is  the  object  area, 
MAj,  is  the  area  of  the  image  in  the  detector  plane  and  Npj  is  the  average  number  of 
photons  in  the  image  plane.  The  average  output  current  of  the  BLIP  detector  will  be^; 


where  is  the  photon  flux  on  the  detector  and  q  is  the  charge  carried  by  one 
photoelectron.  The  probability  that  a  photoelectron  is  produced  when  a  photon  is  incident 
on  the  detector  is  q,  the  quantum  efficiency.  The  rms  noise  current  out  of  the  BLIP 
detector  will  be*: 


(111.19) 


the  ratio  of  (III.18)  and  (111.19)  yields  the  SNR  out  of  the  photodetector; 
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SW«,j3=- 


2A/4yni^ 


iiV,r’(AM)2T 


(III.20) 


M2  A/ 


Noise  is  added  in  the  amplifier  when  the  gain  deviates  from  the  expected  gain.  The 
gain  of  the  amplifier  follows  a  Poisson  probability  density  function^^  with  a  mean  value  of 
G  and  a  standard  deviation  of  a  =  VG.  The  resulting  SNR  after  cascading  the  amplifier’s 
response  to  (III. 20)  is: 


SNR,,^=- 


•’1-4 


nN^2AfqG 


1-4  ynA^^A^Ga^2A^ 


r]N^2AfqG 

U2LfqG 


(III.21) 


if  2AfqG  >  >  1: 


(111.22) 


M2Af 


notice  that  the  SNR  is  independent  of  the  gain  of  the  amplifier. 


The  A/D  converter  samples  the  analog  signal  out  of  the  amplifier  and  provides  a 
digital  equivalent  which  represents  a  grey  level  (GL)  that  can  be  input  to  the  monitor's 
frame  buffer.  An  A/D  with  8  bits  resolution  would  provide  GLs  0  through  255  from  the 
input  voltage,  with  GL  0  being  zero  volts  and  GL  255  corresponding  to  the  maximum  voltage 
signal  out  of  the  amplifier.  Digitization  noise  is  generated  from  the  fact  that  a  range  of 
analog  values  are  mapped  to  the  same  digital  value.  For  example,  with  a  full  range  of  10 
volts  from  the  output  of  the  amplifier  and  8  bits  A/D,  each  GL  represents  a  range  of  39  mV. 
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Having  this  range  causes  an  uncertainty  in  finding  the  original  voltage  value  since,  an  output 
value  of  GL=  1  can  be  generated  by  an  input  voltage  of  exactly  39  mV  or  as  high  as  77  mV. 
This  digitization  noise  manifests  itself  as  "contouring"  to  the  human  observer,  he  sees 
adjacent  digitization  steps  in  the  image  instead  of  the  noise  from  the  scene. 


The  uncertainty  can  be  described  statistically  in  terms  of  a  uniform  distribution.  The 
uniform  distribution  has  a  mean  of  a/2  and  a  standard  deviation  of  a=aVV’  12,  where  a  is  the 
difference  between  neighboring  quantization  levels  (1  GL).  From  this  definition  the 
digitization  noise  .29  GL  and  adds  quadratically  to  the  systems  noise  using  (111.7)^: 


This  quantization  noise  will  be  considered  insignificant  if  its  magnitude  is  less  than  1%  of 
the  other  noises,  <  1.01  a^.^: 


oU^oUimol,  (ni-24) 

i.e.:  if  the  systems  noise  is  greater  than  ISilo^  or  2.08  GL,  the  A/D  noise  can  be 
neglected,  and  the  SNR  out  of  the  A/D  converter  will  be  the  same  as  the  input: 

Sm^.^=SNR^_^  (III.25) 

In  real  life  "noisy"  applications  this  condition  is  met. 


The  next  step  is  to  model  the  display  monitor.  A  typical  CRT  monitor  is  composed 
of  several  components.  The  "monitor  electronics"  consist  of  a  frame  buffer  which  excepts 
digital  inputs,  a  D/A  converter  which  converts  the  digital  signal  to  an  analog  voltage  level 
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and  an  electron  gun  which  converts  the  voltage  into  a  stream  of  electrons.  The  electrons 
from  the  gun  are  then  imaged  onto  a  phosphor  screen  which  emits  photons. 


The  relationship  between  the  voltage  level  into  the  electron  gun  and  the  number  of 
electrons  released  is  a  non  linear  one.  A  result  of  this  non  linearity  can  be  seen  in  the 
characteristic  curve  of  the  monitor.  Figure  III.l  shows  the  characteristic  curve  of  a  US  Pixel 
monitor  measured  by  Hans  Roehrig  et  al.®. 


Figure  III.LThe  Characteristic  Curve  for  a  US  Pixel  Monitor  (reprinted  from  Browne^ 

A  typical  expression  for  the  characteristic  curve  is®; 

L=KE’*  (III.26) 

where  L  is  the  output  luminance  per  pixel,  K  is  a  constant  and  E  represents  the  grid  drive 
voltage.  The  exponent  n  is  device  dependent,  and  is  usually  between  2  and  3.  The 
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experimentally  determined  n  for  the  US  Pixel  monitor  is  2.9.* 


The  relation  between  the  noise  into  the  monitor  from  the  proceeding  components 
(cr^.g)  and  the  noise  in  the  output  signal  is  characterized  by  the  derivative  of  (III.26)®: 

o  =«iCE-’o.  (111-27) 

neglecting  the  noise  generated  by  the  monitor  itself  an  equation  for  the  SNR  per  pixel  out 
of  the  monitor  can  be  formed  by  combining  (III.26),  (III.27)  and  (III.22): 

SNR=—= — (III.28) 


(III.29) 


This  equation  models  the  temporal  and  spatial  SNR’s  per  pixel.  It  would  be 
considered  a  temporal  SNRp  if  one  pixel  were  monitored  over  time  and  the  noise  was  the 
standard  deviation  of  the  luminance  about  the  average  value.  The  spatial  SNRp  is 
determined  from  scanning  the  screen  and  finding  how  the  luminance  varies  from  pixel  to 
pixel.  If  both  sources  of  noise  are  present  the  standard  deviations  add  as  in  (III.7): 


_  /  2  2 
^tt/nporai  ^ ^spatial 


(III.30) 


The  components  considered  above  all  produce  a  temporal  noise  which  is  equal  to  its  spatial 


noise. 


The  monitor  creates  noise  of  its  own.  As  seen  on  Table  III.l  the  electron  beam  has 
shot  noise  which  is  temporal,  there  can  be  both  temporal  and  spatial  variance  in  the 
phosphor’s  gain  and  phosphor’s  granularity  produces  spatial  noise.  The  temporal  noise  of 
the  monitor  is  found  by  cascading  the  electron  beam’s  shot  noise  to  the  phosphor’s  gain: 


=JGN+NG=J2GN, 


(111.31) 


The  spatial  noise  of  the  monitor  is  found  by  adding  the  phosphor’s  noises  in  quadratically: 


(III32) 


Roehrig  et  al.  measured  both  the  temporal  and  spatial  noise  of  the  monitor"*.  The 
results  are  found  in  Figure  III.2.  As  the  graph  shows,  the  spatial  noise  is  much  larger  than 
the  temporal  noise. 


Figure  I  I  1. 2:  Vie  measured  Temporal  and  Spatial  Noise  of  a  US  pixel  Monitor 

(reprinted  from  Vnglan-) 
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From  their  measurements  they  determined  the  SNRp  out  of  the  US  Pixel  Monitor  to  be 
“  30  where  the  input  signal  was  a  noiseless  computer  generated  grey  level.  This  would  be 
considered  the  "monitor  noise  limited"  case. 


The  noise  from  the  monitor  will  add  to  that  of  the  system: 


(III.33) 


When  the  noise  into  the  monitor  is  much  greater  than  the  monitor  noise  >>  the 
system  is  operated  under  background  photon  noise  limited  (BLIP)  conditions  and  (111.29) 
determines  the  signal-to-noise  ratio  per  pixel  (SNRp)  of  the  system. 


III.2  Noise  Equivalent  Temperature  Difference  (NEAT) 

As  discussed  briefly  above,  a  figure  of  merit  used  to  describe  TIS’s  is  the  .NEAT.  The 
NEAT  by  definition  is  the  blackbody  target-to-background  temperature  difference  which  is 
just  large  enough  to  provide  a  SNR  per  pixel  of  1^  The  target  should  be  an  extended 
source  large  enough  to  fill  the  NA  of  a  detector  element  assuring  a  good  signal  response. 
The  basic  expression  for  NEAT  isL 

N£Ar=-^  (1 1 1.34) 

SNR 

Operating  under  BLIP  conditions  a  more  useful  expression  can  be  derived  from  (111.29). 
Since  the  signal  of  interest  is  the  temperature  difference  AT  will  replace  T  : 
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SNR  (111.35) 

'"2.9N|  M2Af 

for  small  AT’s  where  AT  =  -  T^^ckground*  setting  SNRp  =  1  and  solving  for  AT  leaves: 

N£Ar=Ar=(—  f(M2Afi  (III.36) 

t\Aja^iNA)^z 

Figure  III.3  is  a  typical  setup  to  determine  this  AT.  The  blackbody  source  in  the 
object  plane  starts  at  the  ambient  background  temperature.  The  baseline  noise  signal  of  the 
system  is  measured  by  a  detector  at  the  output  of  the  monitor.  The  temperature  of  the 
blackbody  is  increased  until  the  signal  measured  at  the  detector  equals  the  noise.  The  NEAT 
is  the  difference  between  the  final  and  initial  temperatures  of  the  blackbody.  Note  that  the 
detector  is  monitoring  only  one  pixel  of  the  image,  this  is  a  measure  of  the  temporal  SNRp. 
Since  the  temporal  noise  of  the  monitor  is  small  the  system's  noise  will  dominate  and  the 
BLIP  approximation  is  a  proper  one. 


Figure  III.3:  An  experimental  setup  to  determine  the  NEAT 
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The  NEAT  is  a  value  which  quantifies  the  baseline  noise  signal  of  a  thermal  imaging 
system.  It  isn’t  a  very  useful  quantity  because  it  doesn’t  predict  whether  or  not  the  target 
will  be  detected.  On  the  other  hand,  it  can  be  useful  as  a  tool  to  compare  two  different 
designs,  where  the  one  with  the  smaller  NEAT  is  the  better  design. 

III3  Minimum  Detectable  Temperature  Difference  (MDT) 

The  minimum  detectable  temperature  difference  (MDT)  is  similar  to  the  .NEAT,  but 
it  goes  one  step  farther  and  incorporates  the  response  of  the  user  as  seen  in  Figure  II1.4. 
The  MDT  is  the  required  target-to-background  temperature  difference  for  a  human  obser\'er 
to  detect  a  square  target  as  a  function  of  the  targets  size^  This  MDT  is  a  figure  of  merit 
which  characterizes  the  systems  ability  to  resolve  point  sources.  Note  that  since  the  user 
observer’s  the  entire  image  on  the  display  the  monitor’s  spatial  noise  is  dominant. 


Figure  111.4:  An  experimental  setup  to  determine  the  MDT  of  a  TIS 
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Recall  that  the  detection  capabilities  of  the  human  observer  can  be  described  in  terms 
of  a  threshold  contrast  (C,); 


C=^  (UU) 

including  (III.26)  and  (III.  10)  the  threshold  contrast  can  be  written  in  terms  of  the 
temperature  differences  in  the  scene: 


AT^" 

0j^n 


(III37) 


where  AL  =  -  Lb*ck*round«  ”  nonUnear  exponent  (2.9  for  the  US  Pixel  Monitor) 

and  AT  =  -  Tb^kground- 


Figure  I  I  1.5:  Threshold  Contrast  vs  SNR^for  2  different  object  sizes  on  the  US  Pixel  Monitor 

(reprinted  from  Tinglan-) 
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Figure  III.5  was  generated  from  the  psychophysical  experiments  of  Roehrig  et  al.^. 
The  curve  represents  the  threshold  contrast  as  a  function  of  the  SNR  per  pixel  (SNRp)  out 
of  the  display  for  various  object  sizes.  Recall  from  above  that  the  SNRp  for  the  US  Pixel 
monitor  with  dominant  spatial  noise  was  30,  This  is  the  theoretical  limit  for  the  TIS.  If  the 
system  isn’t  "monitor-noise"  limited,  the  SNRp  is  determined  from  the  background  noise 
limited  (BLIP)  operating  conditions  and  (III.29).  In  the  experiment,  computer  generated 
white  noise  of  various  standard  deviations  was  added  to  the  monitor  noise  to  simulate  the 
effects  of  the  TIS. 

The  response  depicted  in  Figure  III.5  can  be  modeled  using  (III.5)  repeated  here  for 
the  reader’s  conveyance: 

Cr 

where  is  the  threshold  SNR  and  has  been  experimentally  determined  to  be  7.78,  N  is  the 
number  of  pixels  of  the  target,  and  the  SNRp  is  the  SNR  per  pixel  out  of  the  TIS. 

The  minimum  detectable  temperature  difference  (MDT)  can  be  calculated  by 
combining  (III.37)  and  (III,5): 

MDr=[(-^^  -T  (III J8) 

y/^NR^ 

for  a  background  temperature  of  300  K  and  the  US  Pixel  monitor  with  n=2.9,  the  MDT  is 


NSNR^ 


(111.5) 
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plotted  for  a  range  of  possible  system  signal  to  noise  ratios  in  Figure  III.6.  Each  curve 
represents  a  different  object  size  (5x5,  10x10  or  15x15  pixels).  As  discussed  above  the 
theoretical  limit  would  be  for  the  "monitor  noise  limited  case"  seen  to  the  right  of  the  curve 
with  SNRp  =  30.  As  the  figure  shows,  the  minimum  detectable  temperature  difference 
increases  from  this  value  with  the  addition  of  noise  to  the  system,  decreasing  SNR.  Also, 
the  temperature  difference  required  to  detect  an  object  decreases  with  larger  objects. 


Figure  III.6:  Vie  MDT  as  a  function  of  SNR^  for  three  different  sized  objects 


The  MDT  determines  the  required  temperature  difference  from  the  background  for 
the  detection  of  a  simple,  impractical,  square  target.  A  more  useful  measure  of  a  TIS's 
performance  is  the  minimum  resolvable  temperature  difference  (MRT)  which  is  a  function 
of  spatial  frequency^  Psychophysical  experiments  could  be  performed  to  determine  the 


threshold  contrast  as  a  function  of  spatial  frequency  by  replacing  the  square  test  target  of 
Figure  II.2,  with  bar  patterns  such  as  Figure  111.7^.  The  observer  would  determine  the 
maximum  frequency  which  can  be  detected  for  each  of  a  range  of  contrasts.  The  Rose 
model  of  (III,5)  would  have  to  be  revisited  to  include  this  spatial  frequency  dependence. 
Finally,  the  optical  transfer  function  (OTF)  of  the  imaging  system  and  modulation  transfer 
function  (MTF)  of  the  electrical  components  which  were  rightfully  eliminated  above  would 
have  to  be  included. 


Figure  III.7:  A  sample  test  pattern  to  determine  the  MRT 
(reprinted  from  Lloyd-} 
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IV  Summaiy 

This  paper  started  with  a  description  of  a  typical  thermal  imaging  system  (TIS).  The 
sections  which  followed  discussed  the  influence  of  the  human  observer  and  each  separate 
component  on  the  signal  and  noise  out  of  the  TIS.  Equations  for  the  signal  to  noise  ratio 
through  the  system  are  formulated  based  on  both  conventional  design  parameters  and 
recently  measured  values  which  model  the  performance  of  a  "state  of  the  art"  US  Pixel 
monitor.  Models  for  the  noise  equivalent  temperature  difference  (NEAT)  and  the  minimum 
detectable  temperature  difference  (MDT)  which  includes  the  response  of  the  human 
observer  to  the  thermal  imaging  system  were  formed.  Finally,  suggestions  for  future  work 
to  include  a  spatial  frequency  dependence  of  the  target  and  determine  the  minimum 
resolvable  temperature  difference  (MRT)  were  offered. 
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